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DETERMINING THE COST EFFECTIVENESS OF TRAINING 
LEARNING OBJECTIVES 

Upon successful completion of this module, you will be able to: 

1. Determine when to measure and report the cost effectiveness of training 

2. Calculate the costs of training 

3. Describe four levels of measuring training effectiveness 

4. Select the outcomes (benefits) to be measured and link training to those outcomes 

5. Compute how much training returns relative to its cost (return on investment) 

6. Compute the yield from training based on the internal rate of return 

7. Justify training investments based on the cost-benefit ratio 

8. Compute the value added from training, using the bottom-line evaluation method 

9. Apply the payback period method to determine how long it will take for training to pay for itself 

10. Describe the advantages and disadvantages of five different methods of determining cost effectiveness 

1 1 . Apply five methods to determine if a training program is cost effective 
RATIONALE (purposes) 

1 . To discuss the need for j ustifying training expenditures with documented benefits 

2. To provide practical details on (a) calculating training costs, (b) measuring the effectiveness of training, and 
(c) methods used in determining the cost effectiveness of training. These methods provide quantitative 
evidence that effective training is a worthwhile investment rather than a cost. 

While this module focuses on the cost effectiveness of training by private sector organizations, the content is also 
applicable to training provided by public (government) employers. 
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INTRODUCTION 

Due to intense competition in an era of rapid economic and technological change, employers are closely 
scrutinizing their spending on workforce training. Increasingly, training departments and human resource 
professionals are being asked to justify whether training is a worthwhile investment. Training managers would 
prefer to measure the effectiveness of their courses and programs with data from criterion-referenced tests and 
feedback questionnaires. However, upper management requires that training be further justified in financial terms 
which they more readily understand. 

This module is organized in three parts. The first part points out why some training managers are reluctant 
to determine the cost effectiveness of training. It discusses the need to justify training with documented bene. *. 
Part 1 also provides practical details and examples of how to calculate the direct, indirect, and full costs of training. 

Part 2 describes four levels of measurement used to determine the effectiveness of training. In addition, the 
need for a cause-and-effect link between a specific organizational problem and a performance deficiency is 
addressed. The second part of the module also discusses the selection of outcomes (benefits) to be baselined before 
training and tracked after training in order to determine the payback. 

Part 3 of the module presents five methods for determining the cost effectiveness of training courses and 
programs. The methods described are: 

1. Return on investment (ROI) 

2. Internal rate of return (LRR) 

3. Cost-benefit ratio 

4. Bottom-line evaluation 

5. Payback period 

In addition to providing details and examples for each of these methods, their advantages and disadvantages are 
identified and listed in a table. 
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At the end of the module is a practical example to facilitate a skill check on your understanding and 
attainment of the learning objectives listed on page 1 . Although with the completion of this module one will be able 
to understand cost effectiveness methods, a flowchart is provided in Appendix B which enables one in initially 
choosing the correct method for determining the cost effectiveness of training. Such a flowchart is useful for 
application outside the context of this module and at the actual worksite. 

Terminology . 

• Cost effectiveness. The results attained against the costs of time, effort, money, and inconvenience. 
Cost effectiveness provides a decision making standard in order to accurately allocate resources among 
competing investments. The criteria for effectiveness are value, worth, and merit. 

• Return on investment (ROI). The rate of what something returns to its costs. It is a calculative 
approach to evaluating a result against the amount of resources invested. 

• Internal rate of return (IRR). The yield from a training investment at which disco unted costs are 
equal to discounted benefits. 

• Cost-benefit. The ratio of projected costs of training to its estimated benefits. It is a useful method for 
justifying training investments when the benefits attributable to training are difficult to quantify in 
monetary units. 

• Bottom-line evaluation. This method shows the value added to each trainee’s job performance and the 
total value added to an organization from training. 

• Payback period. A method for initial consideration of a questionable training investment. It answers 
the question, “How long will it take the training to pay for itself?” 
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Part 1 Training Costs 

WHEN TO MEASURE COST EFFECTIVENESS 

Organizations traditionally supported training because (a) it showed their attention to employees, and 
(b) upper manag ement "assumes" that the benefits exceed the costs. In any event, when upper management 
"believes" that tr aining is operationally critical to the organization’s competitive position, there may be little or no 
demand for cost-effectiveness information. 

Therefore, despite the increasing admonishment found in training literature regarding the importance of 
demonstrating that training is a worthwhile investment, many training managers routinely avoid the use of economic 
justification. However, when a belief in the value, worth, and merit of training is not part of an underlying business 
philosophy, reporting the cost effectiveness of training can help the training manager establish credibility and may 
enhance the organization's willingness to invest additional resources 

The single greatest incentive for indicating cost effectiveness of training is its use in justifying training 
expenditures with documented benefits. Uncertainty about continued support for the training function leads to 
the consideration of cost effectiveness information as a defensive measure — a way of showing upper management 

that training is a necessity and not a luxury. Consequently, a growing number of training managers have a desire to 

✓ ,, 

show a return on training investments similar to that of other business investments. Nevertheless, many lack 
the knowledge necessary to determine the costs and benefits of training courses and programs (Lombardo, 1989, 

pp. 60-61). 

When asked to report on a training investment, training managers often hesitate to calculate the costs 
necessary to develop, deliver, and evaluate training, and are reluctant to document and report the benefits such as 
increased quality, productivity, safety, sales, and so forth. Among the reasons cited for this reluctance are: 

1. Lack of reliable cost figures 

2. Difficulty in identifying, monitoring, and quantifying training benefits 
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3. Subjective nature of the assumptions to be made 

4. Inability to isolate training's influence on performance improvements from other factors 

5. Time and effort involved in calculating the costs and documenting the benefits of training 

6. Potential for unfavorable returns on the investment 

Notwithstanding these and other reasons, training managers who feel the need to justify training with 
evidence that the benefits exceed costs will welcome the opportunity to determine the cost effectiveness of training 
using the methods presented in this module. These methods can provide quantitative evidence that effective training 
is a worthwhile investment rather than a cost. 
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CALCULATING THE COSTS OF TRAINING 

Costs are incurred in developing, delivering, and evaluating training. These costs are categorized as 
direct and indirect. The full cost of training is the sum of all direct and indirect costs. 

Often, the training manager will not have access to many of the costs associated with training but must 
obtain figures or reliable estimates from the organization's payroll, budget, accounting, or comptroller's office. 
Usually, however, all direct and indirect costs can be accounted for, with little guesswork. 

Direct costs . Direct costs are expenses tied specifically to a product (training course or program) (Usry, 
Hammer, & Matz, 1988, p. 26). Direct personnel costs include the wages and benefits paid to or on behalf of 
employees involved in training (e.g., trainees and instructors) as well as fees paid for external training services 
(contractors, consultants, etc.). Also included in direct costs are training development and instructional materials 
preparation (including production) costs, or the review of materials purchased from a vendor. Other direct costs 
are materials and supplies, equipment, facilities, travel and per diem. 

Organizations generally pay all employee/trainee costs. Training is typically conducted during working 
hours; consequently, trainees are not available to perform their regular jobs. As a result, every hour which the 
trainee spends in training costs the organization the equivalent to an hour's wages and benefits for that employee. 

In calculating personnel costs, wages and benefits should be considered as a total compensation package. 
All employer-paid benefits, such as insurance, pensions/profit sharing, tuition assistance, discounts, employee 
lounges, company cars, time paid but not worked (vacation, sick leave, etc.) which are the most costly, and other 
contributions are included (Gilley & Eggland, 1989, p. 267). Thus, an employee’s hourly wage and the 
employer-paid benefits package (usually a percentage of wages) are the total compensation package. In the United 
States, these employer-paid "fringe" benefits average over 40% of direct salary costs (U. S. Chamber of Commerce, 
1994, p. 15). 
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EXAMPLE OF A TOTAL COMPENSATION PACKAGE 

The hourly wage for a inspector is $17. In addition, the fringe benefits package costs the employer an 
additional 30%. The employer’s cost for a welder’s total daily (8-hour) compensation package is: 



$17 x 


8 hours 


+ 30% x 


($17 x 8) 


$176.80 


Hourly 


Hours 


Fringe 


Daily 


Total daily 


wage 


per day 


benefits 


wage 


compensation 






percent 




package 



Additionally, employees' time is worth more than their total compensation package because they are also 
expected to contribute to the organization's profitability. Consequently, there can be a cost of disruption to 
productivity during training time. This cost becomes more apparent as the number of employees away from their 
job and the length of training increases. The loss of contribution to the organization’s profitability and the 
disruption of bringing in possible inexperienced personnel for productivity when other employees are in training is 
opportunity costs. Also, if training is rejected, the net good features (dollar value) of training is the opportunity 
cost of choosing short-term profitability and production goals. 

In order to define these costs, dollar values must be placed upon each individual’s contribution to profit and 
the subsequent results of having inexperienced personnel performing the trainee’s normal job duties and the benefits 
of training. For example, the process of calculating opportunity cost for having training would be the number of 
trainees multiplied by their average combined individual daily output (obtain from production personnel) which 
would then be multiplied by their combined contribution to profit percentage. The individual totals for each 
employee are subsequently added together to provide a total contribution to profit. The contribution to profit 
percentage is determined by obtaining dollar profit projections from the organization’s accounting office and 
dividing it by the total number of employees of the organization which is then multiplied by 100%. Also, the total 
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costs of errors made by inexperienced personnel would be subtracted from the total contribution to profit in order to 
obtain the total opportunity costs for choosing training. Ultimately, the opportunity costs of choosing training and 
not choosing training are compared in order that the best of the two alternatives is chosen. These opportunity costs 
are considered in decision making but are not recognized by accounting professionals as bonafide costs of 
operations (Garrison, 199 1, p. 557). However, depending upon the organization, opportunity costs may need to be 
included in total trainee costs. Thus, the total compensation package is a generally accepted means for calculating 
trainee costs. The calculation of total trainee costs can be based on the number of trainees, length of training, and 
total compensation package. 

EXAMPLE OF TRAINEE COSTS 

Ten welder trainees are attending a two-day workshop on welding techniques. Each welder has a total 
daily compensation package, including benefits, of $176.80. The trainee costs associated with their 
participation in this workshop are: 

10 x 2 days x $176.80 = $3,536.00 

Number of Length of Total daily Trainee 

trainees training compensation costs 



Just as trainee costs are calculated as a direct personnel cost, so should instructor costs be. However, more 
may be involved than just the days the instructor commits to delivering training. In addition, preparation time 
should be added (Deming, 1982, p. 97). 
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EXAMPLE OF INSTRUCTOR COSTS 

An instructor requires 1 day of preparation time for a two-day workshop. The instructor's total 
daily compensation package rate is $200. The instructor costs associated with this workshop are: 



1 


x (2 days 


+ 1 day) 


x $200 


$176.80 


Number 


Length 


Length 


Total 


Total daily 


of 


of 


of 


daily 


compensation 


instructors 


training 


preparation 


compensation 


package 



If an organization contracts for external training services, the costs of developing and delivering the 
training as well as the cost of preparing/producing instructional materials may be lumped together with all other 
costs the contractor or consultant charges. However, when the training is developed internally, training 
development and instructional materials preparation costs need to be calculated. 

Calculation of training development and instructional materials preparation costs can be made based on the 
time expended by the developer(s) and instructional materials production personnel involved, and on the costs of 
materials and supplies required in preparing all types of instructional materials, including printed materials, 
audiovisual media, manipulative aids, etc. A calculation of development and materials preparation costs could look 
like the following example (Deming, 1982, p. 97). 
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EXAMPLE OF TRAINING DEVELOPMENT AND INSTRUCTIONAL MATERIALS PREPARATION 
COSTS 

An developer spends 4 days developing a training workshop and an additional 7 days preparing printed 
instructional materials. No production personnel are involved. The developer's total daily compensation 
package is rate is $225. The cost of materials and supplies required in preparing instructional materials is 
$250. The training development and instructional r'-tferials preparation costs associated with this 
workshop are: 



1 

Number of 
developers 



(4 days 

Days for 
training 
development 



7 days) 

Days for 
materials 
preparation 



$200 

Total 

daily 

compensation 



$250 

Cost of 
materials 
and 

supplies 



$2,725 

Development 

and 

preparation 

costs 



Training development and instructional materials preparation costs can be treated differently than trainee 
and instructor costs insofar as the training will be repeated. For example, if the cost of developing the training and 
preparing instructional materials was $2,725 and the workshop was conducted 10 times, then the development and 
preparation cost assigned to any one workshop would be the total cost ($2,725) divided by the number of 
workshops (10), or $245 per workshop. 

Another way to treat training development and instructional materials preparation costs is to amortize them 
over the number of trainees. For example, if the development and preparation cost was $2,725 and a total of 150 
welders were trained in the 10 workshops, then the cost per trainee would be the total cost ($2,725) divided by the 
number of trainees (150), or $18.17 per trainee. These simple calculations show that (a) the more times the training 
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is delivered, and (b) the more welders trained, the more economical the investment in training development and 
instructional materials preparation will be. 

Frequently, training managers purchase "off-the-shelf' instructional materials marketed by a vendor for a 
number of potential users. The purchase price of instructional materials such as books, modules, video tapes, etc., 
as well as consumable supplies, such as pencils, paper, chalk, and the like, can be grouped under the heading, 
instructional materials costs (Deming, 1982, p. 97). 

Some instructional materials costs are the result of multiplying a per-trainee cost by the number of trainees. 
For example, if 10 trainees each receive a purchased $30 book, the cumulative total cost is $30 multiplied by 10 
trainees, or $30u. 

EXAMPLE OF INSTRUCTIONAL MATERIALS COSTS 

The instructional materials for a paint mixing workshop include books purchased from a vendor, costing a 
total of $300, and consumable supplies which cost $75. The instructional materials costs associated with 
this workshop are: 



$300 + 


$75 


$375 


Purchased 


Consumable 


Instructional 


instructional materials 


supplies 


materials costs 


Training will involve equipment costs when machines must be rented or purchased and then maintain^ 



In other instances, training can be scheduled to use equipment available in the organization (Deming, 1982, p. 98). 
For example, welder training requires the use of a gas tungsten arc pipe welding machine. The machine's usage for 
training may, for all practical purposes, be cost-free if the training can be scheduled when the machine is idle. 

More than likely, however, training workshops would be conducted during normal working hours and the existing 
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pipe welding mar.hinp. could not be diverted for training purposes. Consequently, a duplicate machine would have 
to be rented and maintained. 



EXAMPLE OF RENTED EQUIPMENT COSTS 

The cost of renting a cement mixing machine which is needed for a two-day workshcp is $’.50 per day. In 
additi on , maintenanc e costs for the rented machine are $10 per day. The equipment costs associated with 
this workshop are: 

2 days x ($150 + $10) = $320 

Length of Equipment rental Maintenance Rental and 

training per day cost per day maintenance costs 

of equipment 

When equipment is purchased specifically for training, its purchase price can be amortized (written off) 
over the item's useful life, with yearly maintenance costs added, to find the annual cost. The annual cost is then 
distributed evenly to all training courses in which the item is used. 



EXAMPLE OF PURCHASED EQUIPMENT COSTS 




A cement mixing machine was purchased exclusively for training. 


It cost $24,000 and has an estimated 


useful life of 1C years. The machine has a yearly maintenance cost of $1,800, and it will be used for 10 
workshops per year. The annual equipment cost and cost to each workshop for this machine can be 


calculated as follows. 






( $24,000 


/ 10 years) 


+ $1,800 


= $4,200 


Purchase price 
of equipment 


Useful life 
of equipment 


Maintenance 
cost per year 


Annual 

equipment 

cost 


$4,200 


/ 10 


$420 




Annual 

equipment cost 


Number of 
workshops 


Equipment cost 
per workshop 
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If a workshop uses several pieces of rented or purchased equipment, their costs are added together (Camevale & 
Schulz, 1990, pp. S-12 & S-13). 

Facilities costs are incurred when a training facility is built, shared, or rented. In cases where a building or 
special structure is built for training use, the cost can be amortized over its functional life, with yearly maintenance 
costs added (as in the purchase of equipment). 

When training is conducted within a facility that is used for other organizational functions as well, then the 
appropriate fraction of that facility's cost should be billed to training (Deming, 1982, p. 98). 



EXAMPLE OF FACILITIES COSTS (sharing a facility) 




Organization facilities which are used 1 0% of the time for training have a yearly cost, including 
maintenance and building administration, of $18,000. The annual facilities costs associated with the 


training use of these facilities are: 






$18,000 x 


10% 


= $1,800 


Yearly cost of facilities, 
including maintenance and 
building administration 


Percent of time 
used for training 


Annual facilities 
costs for training 



When organization facilities are used only occasionally for training, a daily rate method may be preferable 
over the percent of use method shown above. To calculate the daily facilities rate, the total annual facilities cost 
(for all functions) is divided by the number of working days in the year. If the organization in the above example 
operates 5 days per week, 52 weeks per year (260 days per year), then their daily facilities rate would be $18,000 
divided by 260 days, or about $69.23. The daily rate is then multiplied by the number of days the facility is used 
for training. For example, the facilities cost for a 2-day workshop would be $69.23 multiplied by 2 days, or 
$138.46. The percent of use method may then be applied to the result, if appropriate. 
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When the rent for a classroom, seminar room, etc. is not a flat fee, total facilities costs for a given 
workshop are computed by multiplying the daily rental rate by the number of rental days. For example, the total 
facilities costs for a 2-day welding workshop held in a vocational training center that charges $200 per day for its 
welding shop would be $200 multiplied by 2 days, or $400. 

For on-site training, travel and per diem costs are likely to be of little consequence. But for training away 
from the workplace, they are costly factors. 



EXAMPLE OF TRAVEL AND PER DIEM COSTS 

Ten cable television technician trainees have traveled to another city for a 2-day workshop. Their employer 
is paying the $300 airfare and $70 daily per diem to cover meals, lodging, and other living expenses for 
each trainee. The employer's costs for travel and per diem for the trainees are: 



( 10 x 


2 days x 


$70) 


+ ( 10 


x $300 ) 


$4,400 


Number of 
trainees 


Length of 
training 


Daily 
per diem 


Number 

of 


Round-trip 

airfare 


Travel and 
per diem costs 



rate trainees 



Indirect costs . Indirect costs are expenses which cannot be traced to a specific training course or program, 
but which are necessary for an organization to function. Although indirect costs for tr aining are less visible than 
direct costs, they are substantial. 

Examples of indirect costs include interest on organizational debt, building repairs, utilities, organizational 
supplies and equipment, administrative and staff support salaries, and expenses for legal, payroll, accounting, and 
other personnel. Organizations often subdivide such costs into overhead and general and administrative (G & A) 
expenses (Camevale & Schulz, 1990, p. S-10). Overhead and G & A expenses often include some of the same 
items such as rent, depreciation, and taxes. However, the distinction between the two expenses should be 
recognized. Overhead expenses are those materials and labor costs which indirectly facilitate the production of a 
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product (i.e. t raining course). On the other hand, G & A expenses facilitate the everyday operations of the entire 
organization. Other items listed under G & A expenses are administrative/office salaries, auditing expenses, legal 
expenses, collections, telephone & telegraph, stationary and printing, and postage. G & A expenses are termed 
commercial expenses of the organization and are apart from producing the actual training program (Usry et al., 
1988, p. 23). 

Consequently, G & A expenses are allocated to all departments, projects, etc. within an organization. The 
concept of allocation stems from the organization’s overall available capital for operations. The organization 
divides out (allocates) a portion (%) of available operational capital to each department or project. This allocated 
portion is a department’s budget. The budgeted amount is divided by total organization operation capital to obtain 
the department or project’s percent of the overall budget. This budgeted percentage is used as the G & A expense 
allocation percentage. Total organization G & A expenses can be obtained from the organization’s accounting 
office and multiplied by the allocation percentage to derive the amount of G & A expenses to be included in total 
indirect costs (Garrison, 1991, p. 699). 

Full cost of training . The final calculation to obtain the full cost of a training course or program is a 
simple addition problem. First, direct costs tied to a course or program are summed, including: 

1 . Personnel costs - total compensation packages for employees involved in training, (e.g., trainees 
and instructors) 

2. Fees for external training services provided by contractors, consultants, etc. 

3. Training development and instructional materials preparation costs including production 

personnel, when involved 

4. Costs of instructional materials (including consumable supplies) purchased from a vendor 

5. Equipment costs 

6. Facilities costs 

7. Travel and per diem costs 
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Second, indirect costs are summed, e.g., overhead, and G & A costs. Finally, the totals from the direct and 
indirect costs are summed to obtain a grand total, the hill cost of training. 



EXAMPLE OF A FULL COST OF TRAINING CALCULATION 

Total direct costs for a 2-day workshop are $10,000. Total indirect costs consist of allocated overhead of 
$1,560 and allocated G & A expenses of $375. The full cost of training is: 



$10,000 


+ 


($1,560 + $375) 


$11,935 


Total 




Total 


Full cost of 


direct costs 




indirect costs 


training 



Conclusion. While calculating the full cost of training is a first and critical step in determining cost 
effectiveness, monitoring costs is also important to planning and controlling the training budget. In addition, by 
analyzing costs, training managers are better able to evaluate the proportion of the organization's investment in 
specific training populations (supervisors, production, maintenance, office workers, etc.), a particular program, 
course, or topic, and so forth. 

This part of the module shows that a training manager can calculate the costs of training, albeit with the 
help of those who have access to fiscal data. More challenging is the art of collecting evidence of favorable training 
outcomes, but it too can be done, as the next part of the module shows. 




18 



17 



PROGRESS CHECK - Part 1 - Training Costs 

This progress check will help you determine how well you understand the content covered in Part 1 of this module. 
If you have difficulty with any of the 13 questions, go back and review the relevant content before continuing. Use 
a calculator or another sheet of paper for your calculations. Answers to the following questions are provided at the 
end of this module. 

1 . Identify die greatest incentive for indicating the cost effectiveness of training. 



2. Name two categories of training costs. 

1. 

2 . 

3 . Calculate the total daily (8-hour) compensation package for an employee whose hourly wage is $ 1 6, and 
whose fringe benefits package costs his employer an additional 29%. 

Total daily compensation package = 

4. Calculate the training costs for 12 trainees, with individual total compensation packages of $195 per day, 
who attend a 5-day training program. 

Total trainee costs = 

5. Calculate the instructor costs for a 5-day workshop with one instructor who requires 2 additional days for 
preparation. The instructor's direct salary is $180 per day, with a 30% benefits package. 

Total instructor costs = 

6. Calculate the training development and instructional materials preparation costs for two developers, with a 
total daily compensation package cost to the organization of $220 each, and who worked 5 days on 
developing training and 8 days on preparing instructional materials. The cost of supplies used in preparing 
the instructional materials was $210. 

Total development and preparation costs = 

7. The cost of developing training and preparing printed instructional materials for a 5-day seminar was 
$6,300. 

A. What will be the cost per seminar if it is offered once each month for one year? 

Cost per seminar = 
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PROGRESS CHECK (continued) 

B. If the seminar is offered only twice, to a total of 30 trainees (15 in each session), what will be the 

cost per trainee? 

Cost per trainee = 

8. The employer purchased books and modules for each of 12 trainees, costing a total of $180 per trainee. 
Paper and pencils, which cost $45 total, were also required. Calculate the total cost of these instructional 
materials. 

Total instructional materials costs = 

9. Welding Associates rented equipment for a 4-day training program they are conducting. The rental cost for 
the equipment is $300 per day. Maintenance costs associated with the equipment are $20 per day. What 
will be foe equipment costs for this training program? 

Equipment costs = 

10. Welding Associates is considering purchasing the arc welding machine needed for training. The machine’s 
purchase price is $22,500, and its estimated useful life is 5 years. In addition, yearly maintenance costs for 
the purchased machine are expected to be $2,100. 

A. What will be the total annual cost of the machine? 

Total annual equipment cost = 

B. If Welding Associates uses the machine in a training program offered 12 times per year, what will 
be the equipment cost for each program? 

Equipment cost per training program = 

1 1 . Welding Associates estimated their total facilities costs, including maintenance, for the current year to be 
$40,000. 

A. If the facilities are used 15% of the time for training, what portion of the facilities costs should be 
allocated to the training budget? 

Facilities costs (for training) = 

B. If the facilities are used for training 5 days per week, 48 weeks per year (240 days per year), what 
is the daily facilities rate for the use of these facilities? 

Daily facilities rate = 
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PROGRESS CHECK (continued) 

12. Six welder-trainees have traveled from their home to another city to attend a 3-day workshop where they 
will learn to use specialized equipment. Welding Associates agreed to pay each employee's $400 airfare 
plus a $75 per day for other expenses. Calculate the travel and per diem costs incurred by Welding 
Associates for this 3-day workshop? 

Travel and per diem costs = 

13. Welding Associates found their direct costs for a training program to be $17,000. Indirect costs, consisting 
of allocated overhead and G & A expenses, totaled $2,000. What is Welding Associates' full cost of 

t raining ? 

Full cost of training = 



O 

ERJC 
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MEASURING THE EFFECTIVENESS OF TRAINING 

t 

Kirkpatrick organized die measurement of training effectiveness (value, worth, and merit) into four levels. 
These levels are listed below, from the easiest to measure (level 1) to the most difficult (level 4). In general, the 
more levels used to measure a training course or program, the more complete is the evidence of its effectiveness. 

• Level 1 — Measurement of trainees' reactions to the training (feedback) 

• Level 2 — Measurement of knowledge and skills acquired 

• Level 3 — Measurement of trainees' use of their new knowledge and skills on the job 

• Level 4 — Measurement of the organization's return on the training investment 

Level 1 information is gathered most often with questionnaires handed out at the end of a course or 
program or sent to trainees a short time later. At level 2, criterion-referenced tests are used to measure the 
knowledge and skills acquired. Level 3 ascertains if trainees are applying the newly-acquired knowledge and skills 
on the job. 

Level 4 determines what benefits (increased quality, productivity, sales, etc.) the new knowledge and skills 
have had on the organization’s performance, and their worth in monetary value. At level 4, training managers are 
asking about the organization's payback (return) on its training investment (Gordon, 1991, pp. 20 & 21). 

In most cases, it is possible and feasible to link training outcomes to organizational improvements. Doing 
so does not require absolute isolation of training's benefits. Rather, it requires evidence that demonstrates t raining 's 
valuable role (Camevale & Schulz, 1990, p. S-16). Consequently, arguments about whether a training manager 
can absolutely separate training's influence on organizational improvements and isolate the impact are not pertinent. 

Indisputable proof is difficult to come by, even when a carefully designed study using experimental and 
control groups is conducted. However, evidence can be collected to show that training was at least a major 
contributor to a particular operational savings or increase in revenue. Kirkpatrick adds that evidence is all anybody 
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really wants, anyhow. "... Management isn't going to ask, 'Can you prove it?' They'll ask for evidence. And 
evidence is not all that hard to come by" (Gordon, 1991, p. 23). 

The key to collecting evidence of training outcomes is to establish a "causal link" between a specific 
organizational problem, preferably one to which monetary value can be assigned, and a performance deficiency. 

This is best done up front, before a training course or program is even developed. 

Rejected workpieces in a manufacturing environment provide one example of an organizational problem. 
How much does the current reject rate cost the organization? Are rejected workpieces the result of a workforce skill 
deficiency, as opposed to inferior matenals or equipment malfunctions? If so, there is a causal link. 

After establishing the link between rejected workpieces and a skill deficiency, current reject costs are 
determined. The accounting office can provide figures for the cost of the materials used in manufacturing the 
workpiece. When this cost is added to personnel, equipment, and other appropriate manufacturing costs, the total 
cost of the rejected workpieces can be calculated. If the number of rejected workpieces declines after the workers 
are trained, the operational saving provides convincing, quantitative evidence that the training provided a return on 
the investment. 

Benefits . By selecting the outcomes or opportunities gained (benefits) to be measured and linking training 
to those outcomes while holding, to the extent possible, other factors constant, level 4 measurement becomes a 
relatively simple matter. All training managers have to do is track the outcomes for which baseline measures were 
gathered before the training, and they will know what the payoff is. Among the most important outcomes (benefits) 
to be documented are (a) increased quality, productivity, sales, service, safety, and workforce flexibility; 

(b) reduced operational costs, medical insurance, and worker’s compensation claims; and (c) lower absenteeism. 
Other outcomes, which are more difficult to document and quantify, include the increased stability of the 
workforce; improved morale, harmony, job satisfaction, and attitude; a lower requirement for supervision; the 
formation of selection pools for promotion; supervisory skill development; and improved customer relations. 
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Conclusion . Once training managers learn bow to calculate the cost and measure the effectiveness of 
training, they can begin to describe the benefits from a financial perspective. Is the training effort producing 
benefits that are greater than the costs involved? This, ultimately, is what upper management wants to know. 

A variety of methods are available for determining the cost effectiveness of training. Some are complex 
and cumbersome to use, while others are more suitable for justifying an investment in a new machine for a 
manufacturing plant, a new way of doing a job, and so forth. The five methods for justifying a training investment 
presented in Part 3 of this module were selected because they are (a) practical, (b) relatively easy to use, and (c) 
generally familiar to upper management. It must be pointed out, however, that all five methods have disadvantages. 
Consequently, none of them should be regarded as a precision tool. Nevertheless, these methods are based on 
accepted principles and present organized state-of-the-art procedures for determining the cost effectiveness of 
training courses and programs. 
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PROGRESS CHECK - Part 2 - Training Effectiveness 

This progress check will help you determine how well you understand the content covered in Part 2 of this module. 
If you have difficulty with any of the questions, go back and review the relevant content before continuing. 
Answers to the following questions are provided at the end of this module. 

1 . Kirkpatrick noted that the effectiveness and efficiency of training can be measured at four different levels. 
Briefly describe the four levels. 

1 . 



2 . 



3. 



4. 



2. Is it possible and/or feasible to link training outcomes to organizational improvements without the absolute 
isolation of training’s benefits from the possible contributions of other variables? 

Yes, it is both possible and feasible. 

It is possible, but not feasible. 

It is feasible, but not possible. 

No, it is neither possible nor feasible. 

3. What is the key to collecting evidence of training outcomes? 



4. Identify the result of selecting the outcomes to be measured and linking training to those outcomes. 
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Part 3 - Methods Used to Determine the Cost Effectiveness of Training 
RETURN ON INVESTMENT (ROI) 
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ROI is the rate at which training returns what was invested (its cost). It is an indicator of a particular 
course or program's value, worth, and merit. Of the five methods of determining the cost effectiveness of training 
presented in this module, the ROI method is probably the most appealing to upper management, since managers are 
accustomed to thinking in terms of return on investment. However, the ROI method is appropriate only when it is 
possible to quantify outcomes (benefits) in monetary units (Kearsley, 1982, p. 92). 

The following steps must be taken before a ROI report can be prepared: 

• Step 1 — Calc ulate the direct and indirect costs associated with the training course or program. 

These costs are then summed to obtain the full cost of training. (See Part 1 of this 
module for details.) 

• Step 2 - Gather baseline measures for those outcomes to be analyzed in step 3, before training 

occurs. This is the only way to know what changes took place. 

• Step 3 — Analyze the effects of the training on outcomes (benefits), such as increased quality, 

productivity, sales, service, safety, and workforce flexibility; reduced operational costs, 
medical insurance and workers’ compensation claims; and lower absenteeism; or any 
other measurable benefit. In order to apply the ROI method, these benefits must be 
quantified in monetary units. 

Once the full cost of training is calculated, and the outcomes have been analyzed, the ROI can be 
computed. Training managers should analyze only those outcomes that are accomplished, at least in part, by 
training. To create a credible ROI report, training managers must present evidence that is important and believable 
to upper management. 
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Two common approaches for expressing the ROI for a training course or program are to consider 
operational savings and increases in revenue. For example, the training manager can assess whether an 
operational cost, such as accidents due to human error, is significantly lower after employees master safety 
procedures. Basarab (1990) suggested that other categories of operational savings and increases in revenue can 
occur by less waste, less reworks, less product liability litigation, fewer employee mistakes, and better morale. In 
this case, the ROI is the rate at which training costs are recovered by a reduction in the number or severity of 
accidents. 

Reductions in accidents positively affect revenue, through lowered health care costs, insurance premiums, 
disability claims, and increases in productivity through fewer absentee days. Upper management will be impressed 
with evidence of training’s valuable role in achieving both operational savings and increases in revenue. 
Consequently, they will look more favorable on training as a value-added service instead of just a “nice to have,” 
but dispensable, cost of operation. 

To calculate a ROI, total operational savings and increases in revenue resulting from the training are 
divided by the total cost of training. ROI expressed as a formula is: 

Operational savings + increase in revenue = 

Full cost of training 

Obviously, any training for which the ROI is greater than one (1.0), the break-even point, is worthwhile, because 
the benefit derived from the training is greater than its cost (we are getting out more than we put in). However, a 
ROI of less than 1 .0 means that the training investment is greater than the return. 
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EXAMPLE OF ROI 

A safety training program resulted in operational savings through a $35,000 reduction in accident costs/ 
payments the first year. There was also an annual increase in revenue of $5,000 as a result of fewer 
absentee days. The full cost of training was $25,000. The program's ROI was: 

$35,000 + $5,000 

= 1.60 (or 160%) 

$25,000 

This training program was a worthwhile investment. It returned 160% - the original $25,000 training cost 
plus an additional $15,000 (60%) in the first year. It will no doubt continue to provide a benefit, even 
without an additional training investment. 
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Advantages of the ROI Method 

• Provides an indicator of the training's value, worth, and merit 

• Easily understood by upper management 

• Management will be impressed with a favorable ROI report and will view training as a value-added 
service 

nigaHvynfo ges of the ROI Method 

• It is appropriate only when it is possible to quantify outcomes (benefits) in monetary units. 

• Baseline measures must be gathered for outcomes before training occurs. 

• Evidence of operational savings and increases in revenue is available only after the training is 
conducted. Therefore its application in predicting a favorable return is limited. 



Note . The advantages and disadvantages of the ROI method can be easily compared with those of the bottom-line 
evaluation and payback period methods by referring to Table 1 on pages 45 and 46. 
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PROGRESS CHECK — Return on Investment (ROI) 

This progress check will help you determine how well you understand the content on the ROI method. If you have 
difficulty with the questions, go back and review the relevant content before continuing. Use a calculator or another 
sheet of paper for you calculations. Answers to the following questions are provided at the end of this module. 

1. A technical training program is saving your organization $20,000 per year and has increased revenue by 

$26,000 per year. The foil cost of training was $40,000 

A. What was foe ROI of this training investment? 

ROI = 



B. Was this a worthwhile investment? 

Yes No 

Why or why not? 



C. Would your opinion change if you could have invested foe $40,000 in a savings fond at a 

guaranteed 17% annual return instead? 

Yes No 

Why or why not? 



O 
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INTERNAL RATE OF RETURN (IRR) 

Internal rate of return is the yield from a training investment. It is the result at which discounted costs are 
equal to discounted benefits. IRR uses the discounting feature in order to consider the time value of money across 
the life of tr aining investments. This method can also be used as an initial screening tool for considering a training 
investment. 

The IRR method is determined through the use of a standardized financial present value of an annuity table 
(See Appendix A). However, information including the cost (investment) of training, the annual cost savings, and 
presumed useful life of the training are required. This denotes another disadvantage to the IRR method in that the 
useful life of training is uncertain and often will be assigned arbitrarily. The investment required is divided by the 
annual cost savings to derive a factor of IRR. Consequently, this factor is found in the present value of annuity 
table coinciding with the extended life of the training. The corresponding rate is the IRR. Resultingly, the IRR is 
compared with a pre-determined and acceptable rate of return (cost of capital) established by the organization’s 
upper management. If the rate is less than the organization’s required rate then the project is unacceptable. A 
project should not be considered if it cannot return results greater than the cost of funds to produce it. 

The IRR method is somewhat complex with the use of tables and that it requires an interpolation when the 
factor of IRR foils between specified table rates or is not found in the tables at all. The IRR method limits an 
organization’s ability to adjust for risk on a questionable project. For example, if the IRR resulted in 12% when the 
required rate of return is 1 1%, the screening still resides with the specified rate of return. The only way to cover the 
risk is to raise the required rate of return but this may eliminate some very good investments. 
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The internal rate of return method is illustrated through the following formula: 



Investment in training 



IRR Factor* 



Annual cost savings 



* Find in Present Value of Annuity Table corresponding to the useful life of the training project. The corresponding 
rate is the IRR. 



EXAMPLE OF IRR 

A comp any is considering an in-house and an out-of-house training program for its computer data entry 
personnel. The investment required for the in-house training is $15,000. Company managers estimate 
that with more efficient data entry the training will save $5,000 per year in overtime pay. Also, the useful 
life of the in-house training is estimated to be 5 years. On the other hand, the out-of-house training 
program will cost $20,000. The out-of-house program will have a useful life of 6 years while resulting in 
savings of $4,000 per year. The organizations cost of capital is 10%. Should the company consider 
either of these programs? 



In-house Training: 



$15,000 



3.00 



$5,000 



Referring to the annuity table (See Appendix A) at 5 years, the IRR would be approximately 20%. 



Out-of-house Training: 



$20,000 



5.00 



$4,000 



Referring to the annuity table (See Appendix A) at 6 years, the IRR would be approximately 5%. The company 
should consider the in-house program. Its IRR is 20%, 10% above the organization’s required rateof return. 
Further calculatio ns show that the out-of-house program should not be considered with an IRR of only 5%. 



O 
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Although the above example, uses the IRR method to make a decision between two types of programs, it should be 
noted that the IRR can be used to consider one training course or program. As long as the IRR can be determined, 
it can be compared to the organization’s required rate of return. 

Advantages o f the IRR Method 

• Considers die time value of money 

• Provides an initial screening for considering training projects 

Disadvanta ges of the IRR Method 

• Is considered complex with the use of additional tables and needed interpolation when the factor of 
IRR fells between specified table rates or is not found in the table 

• Limits the organization’s ability to accurately adjust for risk 

• The useful life of a t raining project is uncertain and often arbitrarily assigned 

Note. The advantages and disadvantages of the IRR method can be easily compared with those of the ROI, 
cost-benefit ratio, bottom-line evaluation , and payback period methods by referring to Table 1 on pages 45 and 46. 
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PROGRESS CHECK - Internal Rate of Return (IRR) 

This progress check will help you determine how well you understand the content on the IRR method. If you have 
difficulty with the questions, go back and review the relevant content before continuing. Use a calculator or another 
sheet of paper and Appendix A for your calculations. Answers to the following questions are provided at the end of 
this module. 

1. A Diversity training program is estimated to save your organization $21,000 per year in legal expenses and 
the foil cost of the training is going to be $50,000. The useful life of the training is considered to be 10 
years. The organization’s required rate of return is 20%. 

A. What is the IRR of this training venture? 

IRR = 



B. Is this a worthwhile investment? 

Yes No 

Why or why not? 



C. Would this training be more worthwhile than an out-of-house training program costing $60,000 
with a useful life of 5 years and an expected annual savings of $25,000 per year? 

Yes No 

Why or why not? 




34 



33 






COST-BENEFIT RATIO 

The cost-benefit analysis (ratio) method is used to determine the ratio of the projected full cost of a given 
course or program to its estimated benefits. This method is especially suitable for justifying training investments 
when the benefits attributable to training are difficult to quantify in monetary units. 

The cost-benefit ratio formula is presented below: 



Projected full cost of training 



Predicted training benefits 



Cost-benefit ratio 



If the cost-benefit ratio is less than one (1 .0), the training would be worthwhile, because its benefits exceed 
its costs. The smaller the ratio, the stronger the justification for training. If the ratio is greater than 1 .0, costs 
exceed benefits and the training may not be justifiable, except when mandated by law (compliance training). 
However, the unknown factor in using the cost-benefit ratio is the actual ratio of return from the training 
(Stromsdorfer, 1972, p. 28). 

The benefits of many courses and programs, such as supervisory skill development, are not easy to show or 
quantify. Benefits such as reduced workforce turnover as well as improved morale, harmony, job satisfaction, and 
attitude are hard to quantify in monetary units, yet they should not be overlooked. No matter how difficult it may 
seem to put a value on employee turnover, for example, and effort must be made to quantify all benefits for this 
method to work. 

Technically precise and entirely objective monetary information simply is not available on the benefits for 
some “soft-skills” training. However, the following practical procedure provides appropriate figures for benefits 
that are difficult to quantify. 

Before training is developed and delivered, line managers re asked to estimate the annual operational 
savings they expect to result for their department. These managers also rate their level of confidence, on a 0 to 
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100% scale, that the training will be responsible for the savings. Estimated operational savings are then multiplied 
by the “confidence” percentage to yield a prediction of total cost savings (benefits) from training. 



EXAMPLE OF COST-BENEFIT RATIO 

A company is considering supervisory skills training for its foremen. The enhancement of supervisory 
skills is expected to reduce workforce turnover. The line managers have been asked to estimate the annual 
operational savings they expect as a result of the reduced turnover and to rate their level of confidence that 
training will be responsible for the savings. They estimated the operational savings (from the reduced 
turnover) at $100,000, with a confidence rating of 50%. The full cost of the potential training program 
is projected to be $10,000. The expected cost-benefit ratio for this training investment is: 



$100,000 x 50% 

Because the cost-benefit ratio is less than 1.0, the training program is considered worthwhile. 



This example is brief, but it illustrates the principles and procedures of the cost-benefit ratio method in providing 
evidence that this soft-skills course is worthwhile. 
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Advantayftg of the Cost-Benefit Ratio Method 

• Especially suitable in training situations where the benefits are difficult to quantify in monetary 

• Practical procedure that provides appropriate figures for benefits that are difficult to quantify. 

• Shows whether or not training is worthwhile, before the course or program is developed and 
delivered 

Disadvantages of the Cost-Benefit Ratio Method 

• The procedure used to predict training benefits in monetary units is subjective. 

• Does not account for differences in return rates 



Note . The advantages and disadvantages of die cost-benefit ratio method can be easily compared with those of the 
ROl, ERR, bottom-line evaluation, and payback period methods by referring to Table 1 on pages 45 and 46. 
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PROGRESS CHECK - Cost-Benefit Ratio 

This progress check will help you determine how well you understand the content on cost-benefit ratio method. If 
you have difficulty with the questions, go back and review the relevant content before continuing. Use a calculator 
or another sheet of paper for your calculations. Answers to the following questions are provided at the end of this 
module. 

1. Mr. Whiz predicted that a computer technician training program for two of his employees would result in a 
total cost savings of $9,000 per year in computer repairs and down-time. He rates his level of confidence, 
that the training will be responsible for this savings, at 80%. The projected full cost of the technician 
training is $2,000 per person. 

A. Calculate the cost-benefit ratio for this potential training investment. 

Cost-benefit ratio = 

B. Do you think this training would be a worthwhile investment for Mr. Whiz’s company? 

Yes No 

Why or why not? 




38 



37 



BOTTOM-LINE EVALUATION METHOD 

The bottom-line evaluation method presented here determines the value added from training to each 
trainee’s productivity, and the total value added to the organization by the training course or program. The total 
value added to the organization is compared to the full cost of training to determine if the training was a worthwhile 
investment. 

This method incorporates two of Kirkpatrick’s four levels of measuring effectiveness of training (See Part 
2 of this module for a description of all four levels). It collects both level 4 (measurement of the organization's 
return on the training investment) and level 1 (measurement of trainee's reactions to the training) data at the same 
time. A questionnaire is developed to collect level 4 and level 1 data from trainees after they have applied, back on 
the job, what they learned in the training. 

Trainees indicate their individual opinions of (a) percent of job-time spent performing the task trained (T), 
(b) pre-training productivity percentages (PI), and (c) post-training productivity percentage (P2). Along with 
questionnaire responses, other information necessary to perform a bottom-line evaluation includes a list of the tasks 
performed by the trainees and their total annual compensation packages (S) (Noonan, 1993, p. 41). The 
bottom-line evaluation method expressed as a formula is: 



( S 


x T ) 


x (P2 -PI) 


Value added 
by training 


Total annual 


Percent of job- 


Percentage change 




compensation 


time spent 


in productivity as a 




package 


performing task 
trained 


result of training 





The bottom line evaluation method promotes the use of job analysis information in that tasks performed by 
the employee/trainee must be identified, along with percent of job-time spent on those tasks, in order to calculate 
per-task compensation (S x T, in the above formula). 
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Criticisms of the bottom-line evaluation method include, (a) trainee questionnaire responses are subjective 
perceptions; and (b) potential for biased questionnaire input. However, the calculated value added can be adjusted 
for bias using statistical methods. 

Despite the criticisms, however, this method does promote employee participation in decision making. 
Employees often feel that they are the best judges of their individual performance improvement following training. 
The method also appeals to management because it links employees’ job task performance with their productivity, 
by compa ring the full cost of the t raining with the value the organization receives from it. 
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EXAMPLE OF BOTTOM-LINE EVALUATION 

A tr aining program in erecting and dismantling scaffolding was provided to three employees. After the 
employees returned to their job and applied the knowledge and skill acquired, they were asked to complete a 
a questionnaire. Each employee supplied information on their perceptions of (a) percent of job-time spent 
perfo rming the task trained, and (b) pre- and post-training productivity percentages. Each employee’s total 
compensation package, percent of job-time spent performing the task trained, and pre-and post-training 
productivity percentages are presented in the table below, along with their individual and total value added 
to the organization as result of the training. 



Employee 

/trainee 


Total annual 
compensation 
package ($) 


Job-time (%) spent 
performing the task 
trained 


Component 
pay ($) 


Pre- 
training 
produc- 
tivity (%) 


Post- 
training 
produc- 
tivity (%) 


Productivity 

gain(%) 


Value 

Added 

(S) 




(S) 


(T) 


(D = S x T) 


(Pi) 


(P2) 


(G = P2 -PI) 


(GxD) 


i 


$29,000 


25% 


$7,250 


30% 


80% 


50% 


$3,625 


2 


$30,000 


20% 


$6,000 


40% 


90% 


50% 


$3,000 


3 


$34,000 


15% 


$5,100 


50% 


80% 


30% 


$1,530 


Total Value Added. 


$8,155 



The total value added to the organization by the training program was $8,155. If the full cost of training 
was less than $8,155, then the training program was a worthwhile investment. 
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Advantages of the Bottom-Line Evaluation Method 

• Promotes the use of job analysis information 

• Promotes employee participation in decision-making 

• Appeals to management, because it links job task performance with training and productivity 

• The total value added to the organization can be compared to the full cost of training to determine 
if the training was a worthwhile investment 

Disadvant ages of th e Bottom-Line Evaluation Method 

• Questionnaire responses are subjective perceptions by trainees 

• Questionnaire data might be biased 

Note. The advantages and disadvantages of the bottom-line evaluation method can be easily compared with those 
of the ROI, ERR, cost-benefit ratio, and payback period methods by consulting Table 1 on pages 45 and 46. 
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PROGRESS CHECK — Bottom-Line Evaluation 

This progress check will help you determine how well you understand the content on the bottom-line evaluation 
method. If you have difficulty with the table or questions, go back and review the relevant content before 
co ntinuing Use a calculator or another sheet of paper for you calculations. Answers to the following table and 
questions are provided at the end of this module. 

1 . A training manager has identified all the tasks performed by each employee within the organization, along 
with their total compensation packages. The training department is providing a welding training program 
for the welding department’s 4 employees, at a total cost of $4,400. Each employee has a total annual 
compensation package of $20,000. The training manager would like to present training's value to upper 
management. The training is delivered and questionnaire results, in table form, are as follows: 



Employee 

/trainee 


Total annual 
compensation 
package ($) 


Job-time (%) spent 
performing the task 
trained 


Component 
pay (S) 


Pre- 
training 
produc- 
tivity (%) 


Post- 
training 
produc- 
tivity (%) 


Productivity 
gain (%) 


Value 

Added 

($) 




(S) 


(T) 


(D = S x T) 


(pi) 


(P2) 


(G = P2 -PI) 


(GxD) 


i 




10% 




20% 


60% 






2 




40% 




20% 


50% 






3 




30% 




30% 


50% 






4 




20% 




40% 


60% 






Total Value Added. 





A. Complete the table. For each employee, you will need to calculate component pay, productivity gain, and 
value added. You will also need to calculate the training program’s total value added to the organization. 
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PROGRESS CHECK (continued) 

B. Was the training program worthwhile? 

Yes No 

Why or why not? 



O 
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PAYBACK PERIOD 

The fifth method of determining the cost effectiveness of a training investment is called the payback period 
method. This forecasting method answers the question, "How long will it take the training to pay for itself?" This 
method should, however, be used only as an initial look at a questionable training investment. 

The payback period method does not consider the cost or time value of the money spent and tied up before, 
during, and after the training until the break-even point is reached. Also, the calculation provides no indication of 
the degree of benefits to be received. Nevertheless, it does consider some time factors in calculating the payback. 

If the payback period is very short, less than one year, for example, then the training course or program is 
definitely promising and another method, such as ROI, cost-benefit ratio, or bottom-line evaluation, should be used 
for a closer examination of the training’s value, worth, and merit to the organization. If the payback period is very 
long, 10 years, for example, then there may be no need to consider the training further, depending on the 
organization’s philosophy about the maximum length of time allowed for investment resources to be returned. 

The payback period method is represented by the following formula: 



Full cost of training Payback period (in years) 

Annual operational savings + increase in revenue 
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EXAMPLE OF PAYBACK PERIOD METHOD 

A company is considering an all-inclusive clerical training program. The lull cost of this training is 
$10,000. Company managers estimate that improved clerical efficiency resulting from the training will 
save the organization $ 1,200 per month ($ 14,400 per year). Should the company give further consideration 
to this training? 

$ 10,000 

$14,400 0.69 years (about 8.3 months or 36 weeks 

Yes, the company should consider the training further. Its payback period is very short, less than one year. 
Further calculation shows that, if the company’s savings estimates are accurate, this investment (a) has a 
worthwhile cost-benefit ratio of only 0.69, and (b) will return 144% in the first year (the training year). 



Advantage of the Payback Period Method 

• Provides a quick initial look at a potential training investment. 

• . Answers the question, “How long will it take the training to pay for itself?’ 

Disadvantage of the Payback Period Method 

• Should be used only as an initial screening tool . If the payback period is short, then another 
method (ROI, IRR, cost-benefit ratio, or bottom-line evaluation) must be used to examine the 
training’s value, worth, and merit to the organization 

• Does not consider the cost or time value of the money spent and tied up before, during, and after 
the training until the break-even point is reached 

• Does not indicate the size of benefits from the training program 

Note . The advantages and disadvantages of the payback period method can be easily compared with those of the 

ROI and bottom-line evaluation methods by consulting Table 1 on the following pages. 
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Table 1. Advantages and Disadvantages of Methods for Determining the Cost Effectiveness of Training 



Method 


Advantages 


Disadvantages 


ROI 


Provides an indicator of the 


Appropriate only when it is 




training's value, worth, and merit 


possible to quantify 
outcomes (benefits) in 
monetary units 




Easily understood by 
upper management 


Baseline measures must be gathered for 
outcomes before training occurs 




Management will be impressed 
with a favorable ROI report 


Evidence of operational savings and 




and will view training as a 


increases in revenue is available 




value-added service 


only after the training is conducted 
Therefore, ROI's application in predicting a 
favorable return is limited. 


IRR 


Considers the time value of money 


Is considered complex with the use of 
additional tables and needed interpolation 




Provides an initial screening for 


when the factor of IRR falls between 




considering training projects 


specified table rates or is not found in the 
table 






Limits the organization ability to accurately 
adjust for risk 






The useful life of a training project is 
uncertain and often arbitrarily assigned 


Cost-benefit 


Especially suitable in training 


The procedure used to predict training 


ratio 


situations where the benefits are 


benefits in monetary units is subjective 




difficult to quantify in monetary units 


Does not account for differences in 




Practical procedure that provides 
appropriate figures for benefits 
that are difficult to quantify 


return rates 




Shows whether or not training is 
worthwhile before the course or 
program is developed and delivered 
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Table 1. (continued) 



Method 


1 

Advantages 


Disadvantages 


Bottom-line 


Promotes the use of job analysis 


Questionnaire responses are subjective 


evaluation 


information 


perceptions by trainees 




Promotes employee participation 
in decision-making 


Questionnaire data might be biased 




Appeals to management, because it 
links job task performance with 
training and productivity 






The total value added to the 
organization can be compared to the 
full cost of training to determine if 
the training was a worthwhile 
investment 




Payback 


Provides a quick initial look at a 


Should be used only as an initial screening 


period 


potential training investment 


tool. If the payback period is short, then 
another method must be used to examine 




Answers the question “How long 


the training’s value, worth, and merit to the 




will it take the training to pay for 


organization 




itself?” 


Does not consider the cost or time value of 
spent and tied up before, during, and after 
till the break-even point is reached 






Does not indicate the size of the benefits 
raining program 
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PROGRESS CHECK - Payback Period 



The progress check will help you determine how well you understand the content on payback period method. If you 
have difficulty with the questions, go back and review the relevant content before continuing. Use a calculator or 
another sheet of paper for you calculations. Answers to the following questions are provided at the end of this 

module. 



1 . 




Fixh Company is considering a training workshop for 12 employees. ^ The total ^st of the training 
workshop (for all 12 employees) is $9,000. The training manager has estimated that the additional tr a i nin g 
would enable the company to increase its revenue by $5,000 per year. He has decided that if the payback 
period was no more than 2 years, then he would give further consideration to the workshop. 

A. Calculate the payback period for this potential training investment. 

Payback period = 

B. Should die training manager consider the training workshop further? 

Yes No 

Why or why not? 
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PRACTICAL EXAMPLE SKILL CHECK 

Background information . The training manager for the Camel Company had no interest in or idea how to 
determine the cost effectiveness of training. Consequently, he avoided the use of economic justification, and upper 
management came to view training as a cost of doing business. During an economic downturn, most of the training 
staff was cut as a result of “down-sizing.” As a result, the training manager decided that he had better learn how to 
justify training as a worthwhile investment he wanted to keep his job. 

The training manager’s first effort was to establish a “causal link” between a specific organizational 
problem and a performance deficiency. Finally, he had to provide evidence, in monetary units, that training was a 
worthwhile investment for the company. 

Because the general manager of the Camel Company was accustomed to making decisions based on return 
on investment (ROI) reports, the training manager chose this method to justify the cost effectiveness of training. 

I. List the three steps the training manager must take before preparing a return on investment report for the 

general manager. 

1 . 



2 . 



3 . 
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PRACTICAL EXAMPLE SKILL CHECK (continued) 

n. The following is a list of outcomes that could be measured. To prepare a credible ROI report, the 

evidence presented to the general manager should be described in which of the following terms? Place an X 
in front of those outcomes (benefits) which would provide convincing evidence that training was 
worthwhile investment. 

1 . How those trained thought the training went 

2. Any increase in operational savings attributable to the training 

3. Any slight reduction in absenteeism attributable to the training 

4. How efficient the trainees' supervisors thought the training program was 

5 . Increased revenue attributable enhanced proficiency of the workers after training 

6. Su gge stions for improving/deleting parts of the training, derived from the training exit 

survey 

7. Enhanced workforce flexibility 

8 . Reduced medical claims attributable to safety awareness from the training program 

9. Any increase in revenue attributable to the t ra i ning 

10. Company executives' feelings about the training program 

1 1 . Reduced operational costs 

IQ. List the advantages and disadvantages of two other methods that the training manager could use to 
determine the cost effectiveness of training. 

Method Advantages Disadvantages 



O 
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PRACTICAL EXAMPLE SKILL CHECK (continued) 



IV. Ten employees in the maintenanc e department went through a one-week (40 hour) training program. The 



training cost were as follows: 

COST ITEM AMOUNT 

Workers' total weekly compensation package (10 workers) $ 8,500 

Trainer’s total weekly compensation package (2 trainers) $ 4,200 

Training development and instructional materials preparation $ 1,000 

Purchased instructional materials and consumable supplies $ 450 

Equipment rental $ 1,000 

Allocated facilities costs ($70 per day) $ 350 

Overhead and G & A expenses (total) $ 500 

Full cost of training $16,000 



Actual benefits of the program were difficult to quantify. However, the benefit item amounts listed on the 
next page were found by (a) taking figures for each item from the 12 monthly periods before the training; 
(b) then obtaining an average of the 12 figures for each item reported, and (c) calculating each item's 
average monthly benefit (the difference between the item average and the figure for the same item after 
training); and (d) annualizing the resulting monthly benefit (by multiplying by 12). 
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PRACTICAL EXAMPLE SKILL CHECK (continued) 

IV. (continued) 

item Annualize benefit amount from training 



Operational costs (reduced) $ 9,600 

Productivity (increased) $13,200 

Absenteeism (decreased) $ 3,000 

Quality (improved) $ 2.400 

Total annual benefit $28,200 



After applying, back on the job, what they learned in training, the employees/trainees completed a 
questionnaire. The response data indicated that, on average, 

(1) 35% of their job-time was spent performing the task trained 

(2) Their productivity in performing the trained task improved 28% as a direct result of the training. 



Using the information given (in item IV), and the payback period method, how long before the break-even 
point for this training was reached? Show all calculations. 

Payback period = 
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PRACTICAL EXAMPLE SKILL CHECK (continued) 

V. Continuing with the information from item IV, and using the ROI, ERR, cost-benefit ratio, and bottom-line 
evaluation methods, determine if this training should be continued or terminated Describe your rationale. 
Use the following criteria: "Any activity in which the organization is involved, including any department 
within the organization, should add appreciably to our goal of 1 1 .5% increase (20% return) in total annual 
revenue over the next five years." (from Camel Company's Vision, Values, and Goals statement.) 

ROI = 

IRR = 

Cost-benefit ratio (using calculated costs and benefits) = 

Bottom-line evaluation (total value added) = 



Determination: 

Continue with the training Terminate with the training 

Rationale: 



O 
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PROGRESS CHECK FEEDBACK - 

Part 1 - Training Costs (pp. 17-19) 

1 . Identify the greatest incentive for indicating the cost effectiveness of training. 

Justifying (mining, expenditures with documented- benefits, (p. 4} 

2. Name two categories of training costs. 

1. direct costs, 

2. indirect costs 

3. Calculate the total daily (8-hour) compensation package for an employee whose hourly wage is $16, and 
whose fringe benefits package costs his employer and additional 29%. 

Total daily compensation package = (16 x 8 hours j ± (29% x$16_x_8 hours 1 =57 65. 12 

4. Calculate the training costs for 12 trainees, with individual total compensation packages of $195 per day, 
who attend a 5-day training program. 

Total trainee costs = 72 trainees, x 5 days x $195 = SI 7. ZQQ 

5. Calculate the instructor costs for a 5-day workshop with one instructor who requires 2 additional days for 
preparation. The instructor's direct salary is $180 per day, with a 30% fringe benefits package. 

Total instructor costs = 7 instructors (5_+_2 days) x [_ $180 + ($180 x 30%)]_ = $1,638 

6. Calculate the training development and instructional materials preparation costs for two developers, with a 
total daily compensation package cost to the organization of $220 each, and who worked 5 days on 
developing training and 8 days on preparing instructional materials. The cost of materials and supplies 
used in preparing the instructional materials was $210. 

Total development and preparation costs = 72 developers x (8 + 5 days) x $2201 ± 5 270 = $5,930 

7. The cost of developing training and preparing instructional materials for a 5-day seminar was $6,300. 

A. What will be the cost per seminar if it is offered once each month for one year? 

Cost per seminar = $6.300/ 72 times offered_ = $525 
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PROGRESS CHECK FEEDBACK - Part 1 - Training Costs (continued) 

B. If the seminar is offered only twice, to a total of 30 trainees ( 1 5 in each session), what will be the 
cost per trainee? 

Cost per trainee = 5 ( 5 . 300/ 10 = $630 

8. The employer purchased books and modules for each of 12 trainees, costing a total of $ 180 per trainee. 
Paper and pencils, which cost $45 total, were also required. Calculate the total cost of these instructional 
materials. 

Total instructional materials costs = ($180 x 72 trainees) + $45 = $2.205 

9. Welding Associates rented equipment for a 4-day training program they are conducting. The rental cost for 
the equipment is $300 per day. Maintenance costs associated with the equipment are $20 per day. What 
will be the equipment costs for this training program? 

Equipment costs = 4 days x (£300 + $20) = $1,280 

10. Welding Associates is considering purchasing the arc welding machine needed for training. The machine’s 
purchase price is $22,500, and its estimated useful life is 5 years. In addition, yearly maintenance costs for 
the purchased machine are expected to be $2,100. 

A. What will be the total annual cost of the machine? 

Total annual equipment cost = ($ 22 1 500/5 yean} ± $2J_00 = $6j500 

B. If Welding Associates uses the machine in a training program offered 12 times per year, what will 
be the equipment cost for each program? 

Equipment cost per training program = $6.600 annual cost/j2 times offered = $550 

1 1 . Welding Associates estimated their total facilities costs, including maintenance, for the current year to be 
$40,000. 

A. If the facilities are used 1 5% of the time for training, what portion of the facilities costs should be 
allocated to the training budget? 

Facilities costs (for training) = $40.000 x 15% = $6,000 

B. If the facilities are used for training 5 days per week, 48 weeks per year [5 days x 48 weeks = 240 
days per year/. What is the daily facilities rate for the use of these facilities? 

Daily facilities rate = 540.000/240 days = $166. <57 
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PROGRESS CHECK FEEDBACK - Part 1 - Training Costs (continued) 

12. Six welders will travel from their home to another city to attend a 3-day workshop where they will learn to 
use specialized equipment. Welding Associates agreed to pay each employee’s $400 airfare plus $75 per 
day for other expenses. Calculate the travel and per diem costs incurred by Welding Associates for this 
3-day workshop? 

Travel and per diem costs = (6 welders x 3 days x 575) + (6 x 5 400 gir fare) = $3. 750 

13. Welding Associates found their foil direct costs for a training program to be $17,000. Indirect costs, 
consisting of allocated overhead and G & A expenses, totaled $2,000. What was Welding Associates’ full 
cost of training? 

Full cost of t raining = $17.000 + 5 2.000 = $19.000 
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PROGRESS CHECK FEEDBACK - 

Part 2 - Training Effectiveness (p. 23) 

1 . Kirkpatrick noted that the effectiveness and efficiency of training can be measured at four different levels. 

Briefly describe the four levels. 

1. (See gage 20} 



2 . 



3. 



4. 



2. Is it possible and/or feasible to link training outcomes to organizational improvements without the absolute 
isolation of training’s benefits form the possible contributions of other variables? 

X Yes, it is both possible and feasible, (p. 20) 

It is possible, but not feasible. 

It is feasible, but not possible. 

No, it is neither possible nor feasible. 

3 . What is the key to collecting evidence of training outcomes? 

Establish a causal link between a specific organizational problem , preferably a problem to which 

monetary, value can be assigned, and a performance deficiency, /p. 21} 



4. Identify the result of selecting the outcomes to be measured and linking training to those outcomes. 
Level 4 measurement becomes a relatively simple matter, (p. 21} 



O 
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PROGRESS CHECK FEEDBACK - 

Return on Investment (ROI) (p. 28) 

1. ■ A technical training program is saving your organization $20,000 per year and has increased revenue by 
$26,000 per year. The full cost of training was $40,000 

A. What was the ROI of this training investment? 

ROI = 

C$20.000 ± $26.000)/ $40.000 = 1_J5 or 1J5% 

B. Was this a worthwhile investment? 

Yes JC No 

Why or why not? 

The ROI js greater than one (1.0). the breakeven point. The training investment js returning 
jl5% per year. The first year, this is the original training investment eIm SH additional 
$6.000 (or 15%}. The twining. MIL no doubt continue to provide a benefit even without 
additional investment. 

C. Would your opinion change if you could have invested the $40,000 in a savings fund at a 
guaranteed 17% annual return instead? 

Yes No X 

Why or why not? 

In the first year, the 17% return on savings would be better than the 15% return from the 
training investment. However . the training investment will no doubt continue to provide a 
return without an additional mvestment. 
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PROGRESS CHECK FEEDBACK - 

Internal Rate of Return (IRR) (p. 32) 

1 . A Diversity training program is estimated to save your organization $2 1 ,000 per year in legal expenses and 
the full cost of the training is going to be $50,000. The useful life of the training is considered to be 10 
years. The organization’s required rate of return is 20%. 

A. What is the IRR of this training venture? 

IRR = 

$50.000/$21.000 - 2. 38: Using Appendix A at 10 years. 2.414 is the lowest IRR found iU the 
table and it fells under the category, of a 40% IRRi if 238 is rounded it can be interpolated 
that the IRR of this training is 40% 

B. Is this a worthwhile investment? 

Yes X No 

Why or why not? 

This training will return 40% and it is 20% above the organization ’l required rate of_ return of 

20 %. 



C. Would this training be more worthwhile than an out-of-house training program costing 60,000 with 
a useful life of 5 years and an expected annual savings of $25,000? 

Yes No X 

Why or why not? 

$60. 000/S25. 000 = 2, 4: Using Appendix Aat_5_ years, a factor of_ 2. 436 isjornd which can 

be equgtec[ with the IRR factor of 2.4 and corresponds to an IRR of 20%: This framing would, not 
be as worthwhile as the training in gart_A because it doesn ’£ have as high o£an IRR. 
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PROGRESS CHECK FEEDBACK - 
Cost-Benefit Ratio (p. 36) 

1 . Mr. Whiz predicted that a computer technician training program for two of his employees would result in a 

total cost savings of $9,000 per year in computer repairs and down-time. He rates his level of confidence, 
that the training will be responsible for this savings, at 80%. The projected full cost of the technician 
training is $2,000 per person. 

A. Calculate the cost-benefit ratio for this potential training investment. 

Cost-benefit ratio = (2 trainees x 520001/ ($9.000 x 80%) = 0,556 

B. Do you think this training would be a worthwhile investment for Mr. Whiz’s company? 

Yes X No 

Why or why not? 

The cost-benefit ratio ofthis potential t raining investment is less than one (LOT 
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PROGRESS CHECK FEEDBACK - 

Bottom-Line Evaluation (pp. 41-42) 

1 . A t raining manager has identified all the tasks performed by each employee within the organization, along 
with their total compensation packages. The training department is providing a welding training program 
for the welding department’s 4 employees, at a total cost of $4,400. Each employee has a total annual 
compensation package of $20,000. The training manager would like to present training's value to upper 
management The training is delivered and questionnaire results, in table form, are as follows: 



Employee 

/trainee 


Total annual 
compensation 
package ($) 


Job-time (%) spent 
performing the task 
trained 


Component 
pay ($) 


Pre- 
training 
produc- 
tivity (%) 


Post- 
training 
produc- 
tivity (%) 


Productivity 

gain(%) 


Value 

Added 

(S) 




(S) 


(T) 


(D = S x T) 


(pi) 


(P2) 


(G = P2 ~P1) 


(GxD) 


i 


$20,000 


10% 


$2,000 


20% 


60% 


40% 


$ 800 


2 


$20,000 


40% 


$8,000 


20% 


50% 


30% 


$2,400 


3 


$20,000 


30% 


$6,000 


30% 


50% 


20% 


$1,200 


4 


$20,000 


20% 


$4,000 


40% 


60% 


20% 


$ 800 


Total Value Added. 


$5,200 



A. Complete the table. For each employee, you will need to calculate component pay, productivity gain, and 
value added. You will also need to calculate the training program’s total value added to the organization. 
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PROGRESS CHECK (continued) 

B. Was the training program worthwhile? 

Yes X No 

Why or why not? 

The value added to the organization by the training ($5. 200) was greater than the training investment 

(MJOQL 
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PROGRESS CHECK FEEDBACK - 
Payback Period (p. 47) 

1 . Fixit Company is considering a training workshop for 1 2 employees. The total cost of the training 

workshop (for all 12 employees) is $9,000. The training manager has estimated that the additional training 
would enable the company to increase its revenue by $5,000 per year. He has decided that if the payback 
period was no more than 2 years, then he would give further consideration to the workshop. 

A. Calculate the payback period for this potential training investment. 

Payback period = $9. 000/ $5. 000 = 1.8 years 

B. Should the training manager consider the training workshop further? 

Yes X No 



Why or why not? 

The payback period was less than the tjmning. manager 's cut-off of 2 years. 
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PRACTICAL EXAMPLE SKILL CHECK FEEDBACK (pp. 48-52) 

I. List the three steps the training manager must take before he can prepare a return on investment report for 

the general manager. 

1. Calculate the direct and indirect costs associated with the training. Then add these costs to 

obtain the ML cost oL training: 

2. Baseline those outcomes to be analyzed in step 3. ; 

3. Analyze the effects of training, on the outcomes (benefits}. 
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PRACTICAL EXAMPLE SKILL CHECK FEEDBACK (continued) 

n. The following is a list of outcomes that could be measured. To prepare a credible ROI report, the 

evidence presented to the general manager should be described in which of the following terms? Place an X 
in front of those outcomes (benefits) which would provide convincing evidence that training was 
worthwhile investment. 

1 . How those trained thought the training went 

X 2. Any increase in operational savings attributable to the training 

3. Any slight reduction in absenteeism attributable to the training 

4. How efficient the trainees' supervisors thought the training program was 

X 5. Increased revenue attributable enhanced proficiency of the workers after training 

6. Suggestions for improving/deleting parts of the training, derived from the training exit 

survey 

7. Enhanced workforce flexibility 

8. Reduced medical claims attributable to safety awareness from the training program 

X 9. Any increase in revalue attributable to the training 

10. Company executives' feelings about the training program 

X 11. Reduced operational costs 

ID. List the advantages and disadvantages of two other methods that the training manager could use to 

determine the cost effectiveness of training. 

Method Advantages Disadvantages 



(See Table 1, pages 45 and 46) 
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PRACTICAL EXAMPLE SKILL CHECK FEEDBACK (continued) 

IV. Ten employees in the maintenance department went through a one-week (40 hour) training program. The 



training cost were as follows: 

COST ITEM AMOUNT 

Workers' total weekly compensation package (10 workers) $ 8,500 

Trainer's total weekly compensation package (2 trainers) $ 4,200 

Training development and instructional materials preparation $ 1,000 

Purchased instructional materials and consumable supplies $ 450 

Equipment rental $ 1,000 

Allocated facilities costs ($70 per day) $ 350 

Overhead and G & A expenses (total) $ 500 

Full cost of training $16,000 



Actual benefits of the program were difficult to quantify. However, the benefit item amounts listed on the 
next page were found by (a) taking figures for each item from the 12 monthly periods before the training; 
(b) then obtaining an average of the 12 figures for each item reported, and (c) calculating each item’s 
average monthly benefit (the difference between the item average and the figure for the same item after 
training); and (d) annualizing the resulting monthly benefit (by multiplying by 12). 
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PRACTICAL EXAMPLE SKILL CHECK FEEDBACK (continued) 

IV. (continued) 

Benefit item Annualize benefit amount from training 



Operational costs (reduced) $ 9,600 

Productivity (increased) $13,200 

Absenteeism (decreased) $ 3,000 

Quality (improved) $ 2,400 

Total annual benefit $28,200 



After apply ing^ back on the job, what they learned in training, the employees/trainees completed a 
questionnaire. The response data indicated that, on average, 

(1) 35% of their job-time was spent performing the task trained 

(2) Their productivity in performing the trained task improved 28% as a direct result of the trai ning . 



Using the information given (in item IV), and the payback period method, how long before the break-even 
point for this tr aining was reached? Show all calculations. 

Payback period = $16.000/ $28.200 = 0.57 years (about 68 months or 29.5 weeks} 



O 

ERLC 
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PRACTICAL EXAMPLE SKILL CHECK FEEDBACK (continued) 

V. Co ntinuing with the information from item IV, and using the ROI, IRR, cost-benefit ratio, and bottom-line 
evaluation methods, determine if this training should be continued or terminated Describe your rationale. 
Use the following criteria: "Any activity in which the organization is involved, including any department 
within the organization, should add appreciably to our goal of 11.5% increase (20% return) in total annual 
revenue over the next five years." (from Camel Company's Vision, Values, and Goals statement.) 

ROI = 828.200/ 816.000 = l_J6or 17m 

IRR= 816.000/828.200 = 0.57; Usins Appendix A and searching for 0S7_ at 5 years, the lowestlRR 

factor is 2.035: It can be interpolated that the training will return more than 40%. 

Cost-benefit ratio (using calculated costs and benefits) = 5 16 1 000/^28 1 200 = .057 

Bottom-line evaluation (total value added) = f ($8.500 x 52 weeks) x 35% iob-time on taskl x 28% 

improvement = $43.316 



Determination: 

Continue with the training X Terminate with the training 

Rationale: 

The training, returns the (mining, investment plus an additional 76% jn the first year, far more than the 

stipulated 1 1.5% annual return. 

The IRR is more than 20% mow than the organization 's required rate of return. 

The cost-benefit ratio is well below one (1 .Of 

The value added to the organization bv the training is more than 2 dmes sreater than the twining 
investment 
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Appendix A 

Present Value of an Annuity Chart for Calculating IRR 
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Appendix B 

Flowchart for Choosing a Method for Determining Cost Effectiveness 
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